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Rate Regions for Relay Broadcast 

Channels ^ ^ 

Yingbin Liang and Gerhard Kramer ^ 
Abstract 

A partially cooperative relay broadcast channel (RBC) is a three-node network with 
one source node and two destination nodes (destinations 1 and 2) where destination 1 
can act as a relay to assist destination 2. Inner and outer bounds on the capacity region 
of the discrete memoryless partially cooperative RBC are obtained. When the relay 
function is disabled, the inner bound reduces to an inner bound on the capacity region 
of broadcast channels that is at least as large as Marton's inner bound. The outer 
bound reduces to a new outer bound on the capacity region of broadcast channels that 
generalizes an outer bound of Marton to include a common message, and that general- 
izes an outer bound of Gel'fand and Pinsker to general discrete memoryless broadcast 
channels. Our proof for this outer bound simplifies the proof of Gel'fand and Pinsker 
that was based on a recursive approach. Four classes of RBCs are studied in detail. 
For the partially cooperative RBC with degraded message sets, inner and outer bounds 
are obtained. For the semideterministic partially cooperative RBC and the orthogo- 
nal partially cooperative RBC, the capacity regions are established. For the parallel 
partially cooperative RBC with unmatched degraded subchannels, the capacity region 
is established for the case of degraded message sets. The capacity is also established 
when the source node has only a private message for destination 2, i.e., the channel 
reduces to a parallel relay channel with unmatched degraded subchannels. 



1 Introduction 

Relay broadcast channels (RBCs) are communication networks where a source node trans- 
mits information to a number of destination nodes that cooperate by exchanging information. 
These channels model "downlink" communication systems that incorporate relaying and user 
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cooperation to achieve higher throughput. Three RBC models have been studied recently. 
In [T], a two- destination partially cooperative RBC model (see Fig. [T](a)) was studied, where 
one destination node (destination 1) acts as a relay [21 El and transmits cooperative infor- 
mation to the other destination node (destination 2). It was shown that the capacity region 
of the original broadcast channel (BC) was improved due to relaying and user cooperation. 
This RBC model was further studied in [4] for the case of more than two destinations, where 
bounds on the capacity region and minimum energy per bit were derived. The fully coopera- 
tive RBC (see Fig.^(b)) is a more general model studied in [Tl where both destinations relay 
information to each other. The partially and fully cooperative RBCs were also studied in ^ 
for the case where the relay-to-relay (or destination-to-destination) channels are orthogonal 
to each other and to the broadcast channel. A third RBC model called the dedicated-relay 
BC (see Fig. [T](c)) was studied in P and [11, where an additional relay node was introduced 
to the broadcast channel to assist all destination nodes. 

For the partially cooperative RBC, the achievable rate regions given in pP are based on 
the source node using superposition encoding and the relay employing a decode-and-forward 
scheme. These encoding schemes were shown to be optimal for certain cases, e.g., for de- 
graded partially cooperative RBCs, physically degraded Gaussian channels, and feedback 
channels. The achievable regions given in [1] are based on the source node using either 
superposition encoding or binning and the relay using a decode-and-forward scheme. In 
general, these encoding schemes are not optimal. 

In this paper, we derive improved inner and outer bounds on the capacity region of the 
partially cooperative RBC. For the inner bounds, the source node uses superposition en- 
coding and binning, and the relay employs a partial decode-and-forward scheme. Our outer 
bound is different from the outer bounds given in P and is based on a different approach. By 
choosing the relay channel inputs to be null, both our inner and outer bounds reduce to new 
bounds on the capacity region of broadcast channels. In particular, our new inner bound on 
the broadcast channel capacity region is at least as large as Marton's inner bound 0. Our 
new outer bound generalizes Marton's outer bound [71 to include common messages, and 
generalizes Gel'fand and Pinsker's outer bound P| to general discrete memoryless broadcast 
channels. Furthermore, our proof for the bound is different from the proof given in |H] that 
was based on a recursive approach. 

We study four classes of partially cooperative RBCs in detail. The first channel is the 
partially cooperative RBC with degraded message sets, where the source node has a common 
message for both destinations and a private message for destination 1. For this channel, our 
inner and outer bounds have the same form. However, the joint distributions for the two 
bounds satisfy different Markov chain conditions, and thus prevent us from claiming we have 
found the capacity region. 

The second channel is the semideterministic partially cooperative RBC, where the relay 
(destination 1) output is a deterministic function of the source and relay inputs. This model 
is a generalization of the semideterministic broadcast and relay channels studied in |8| and 
ini, respectively. We establish the capacity region for this channel and illustrate our result 
via an example channel, which we call the Blackwell partially cooperative RBC. 
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(a) Partially Cooperative RBC (see also Fig. Ej) 




(b) Fully Cooperative RBC 




(c) Dedicated-relay EC 



Figure 1: Three Relay Broadcast Channels 
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The third channel we study is the orthogonal partially cooperative RBC, where the source 
transmits to destination 1 in one channel and the source and relay transmit to destination 
2 in another orthogonal channel. This model is a generalization of the relay channel with 
orthogonal components studied in JUl- For this channel, we establish the capacity region 
for both the discrete memoryless and Gaussian cases. 

The fourth channel we study is the parallel partially cooperative RBC with unmatched 
degraded subchannels, which consists of two degraded partially cooperative RBCs as sub- 
channels from the source node to the two destination nodes. In the first subchannel, the 
output of destination 2 is a degraded version of the output of destination 1, and in the second 
subchannel, the output of destination 1 is a degraded version of the output of destination 2. 
Our inner and outer bounds on the capacity region do not match in general for this channel. 
Three cases are further studied. For the case of degraded message sets, i.e., where the source 
has a common message for both destinations and a private message for destination 1, we 
establish the capacity region. For case 2 where the source has only a private message for 
destination 2, i.e., the channel reduces to the parallel relay channel with unmatched degraded 
subchannels, we obtain the capacity. For case 3 where the source has only private messages 
for the destinations, we show that the achievable region is larger than the Minkowski sum 
of the capacity regions of the two subchannels. This is in contrast to the capacity of parallel 
broadcast channels with unmatched degraded subchannels [TT] I12j. 

The organization of this paper is as follows. In Section |2l we describe the partially co- 
operative RBC model. In Section El we present inner and outer bounds on the capacity 
region of the partially cooperative RBC that give new bounds on the capacity region of the 
broadcast channel. In Sections |3]|71 we present our results for four classes of channels, namely 
the partially cooperative RBC with degraded message sets, the semideterministic partially 
cooperative RBC, the orthogonal partially cooperative RBC, and the parallel partially co- 
operative RBC with unmatched degraded subchannels. Section |H1 concludes the paper. Note 
that Sections OHni appeared in the Ph.D. thesis of the first author ^3 Chap. 5]. 

2 Channel Model 

The partially cooperative RBC consists of a source input alphabet X, a relay input alphabet 
Xi, and two channel output alphabets and 3^2- The channel is characterized by the 
probability distribution p{yi,y2\x,Xi), where x indicates the source input, Xi indicates the 
relay input of destination 1, and yi and ?/2 indicate the outputs at destinations 1 and 2, 
respectively. We assume that the channel is memoryless, i.e., the present channel outputs 
depend on the messages, the previous channel inputs, and the previous channel outputs only 
through the present channel inputs. 

Fig. 121 illustrates the channel model. The source has a common message Wq that is decoded 
by both destinations, and private messages Wi and W2 that are decoded by destinations 1 and 
2, respectively. The channel reduces to a broadcast channel jHj if destination 1 (the relay) 
does not relay information to destination 2. The channel reduces to the relay channel 
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if the source has only a private message W2 intended for destination 2. As in Fig. |2l we use 
upper case letters to indicate random variables and lower case letters to indicate realizations 
of random variables. Exceptions will be clarified where they appear in the paper. We use 
and to represent the vectors (xi, . . . , Xn) and (xj, . . . , x„), respectively. 
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Figure 2: Partially cooperative RBC 



A communication strategy for n channel uses and with rate-triple [Rq, Ri, R2) consists of 
the following: 

• Three message sets >Vfc = {1, 2, . . . , 2'^^'=}, k = 0,l, 2; 

• Three independent messages Wo, Wi and 14^2 that are uniformly distributed over 
Wo, Wi and W2, respectively; 

• An encoder that maps each message triple {wo,wi,W2) to a codeword G A""; 

• Deterministic relay functions /i, /2, • • • , /n such that Xu = fi{yu, ■ ■ ■ , yi[i-i]) for 
1 < i < n; 

• Two decoders: destination k, k = 1,2, maps y"^ to a pair {wQ^\wk) G Wo x Wk- 
The probability of error when the message triple (Wq, Wi, W2) is sent is defined as 

Pe{Wo,Wi,W2) 

= Pr\^{W^^\w) + {Wo,W^) or {w'i\W2) + {Wo,W2)\ 
and the average block probability of error is 

2"^o 2"^i 2"^2 

= Onn^OnR^nnR. E E E , ^ , W^^) • (2) 



Wo=l Wi=l W2=l 



The rate triple {Rq, Ri, R2) is said to be achievable for the partially cooperative RBC if, 
for any e > 0, there is a (sufficiently long) code with < e. The capacity region is the 
closure of the set of all achievable rate triples. 
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3 Bounds for Partially Cooperative RBCs and Broad- 
cast Channels 



We use superposition encoding [1^] and binning [TB] at the source node, and the decode- 
and- forward scheme for the common message Wq. The result is Theorem ^ We then 
enlarge our achievable region in Theorems |21 and El The resulting regions are using the 
decode- and-forward scheme for the common message Wq and a partial decode-and-forward 
scheme 0111 for the private message W2- 

Theorem 1. The following is an achievable region for the partially cooperative RBC: 

(i?0, Rl, R2) '■ 

Ro >0,Ri> 0, R2 > 0, 
R'l >0,R'2> 0, 
Ri + R[<I{Ui;Y^\T,Xi), 
Ro + Ri + R[<I{T,Ui;Yi\Xi), 
R2 + R'2<I{U2-MT,X^), 
Ro + R2 + R'2<I{T,X^,U2;Y2), 
R[ + R',>I{U,;U2\T,X,), 



u 

p{Xi,t,Ui,U2.,x) 



Furthermore, the region 7l[ is equivalent to the following region: 

U 

p{xi, t, ui, U2, x)p{yi, y2\xi,x) 

{Rq, Rl, R2) : 
^0 > 0, i?i > 0, R2 > 0, 
i?i < J([/i;yi|T,Xi), 
Ro + Ri<I{T,Ui-Yi\Xi), 
R2<IiU2;Y2\T,Xi), 
R^ + R2<I{T,Xi,U2;Y2 



X, 



Ko + K2< i[i,^uU2; rsj, 

Ri + R2< I{Ui; Yi\T, X^) + I{U2; X^) - I{Ui; U2\T, X^] 
Ro + Ri + R2< I{T, f/i; Yi\Xi) + /(f/2; FslT, Xi) - /([/i; t/sl'. , ..i 
Ro + Ri + R2< I{Ui- Yi\T, Xi) + /(T, Xi, U2; Y2) - /(f/i; U2\T, Xi, 
2Ro + Ri + R2< I{T, Ui- Y,\X,) + /(T, Xi, f/2; Y2) - I{Ur, f/alT, X 



(3) 



(4) 



Proof. The proof of the achievability of TZ'^ is provided in Appendix ^ The region TZi is 
obtained from TZ'^ by applying Fourier- Motzkin elimination (see, e.g., [T7j) to eliminate i?'^ 
and i?2 from the bounds in Q. □ 



The following lemma states a property ^Hj that we use to enlarge TZi in Theorem El 

Lemma 1. If the rate triple (Rq, Ri, R2) is achievable for the partially cooperative RBC, 
then the rate triple [Rq — Ai — A2,Ri + Ai,i?2 + A2) is also achievable, where Ai > 0, 
A2 > and Ai + A2 < Rq- 
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Theorem 2. The following is an achievable region for the partially cooperative RBC: 



Tit 



u 

p{xi, t, Ml, U2, x)p{yi, y2\xi,x) 

{Rq, R2) : 
^0 >0,Ri> 0, R2 > 0, 
Ro + Ri<IiT,Ui;Y,\Xi), 
R^ + R2<I{T,Xi,U2;Y2' 



Ko + K2< i[i,Jii,U2;r2), 

Ro + Ri + R2< I{T, f/i; Y,\Xi) + /(f/2; Y2\T, Xi) - I{Uu U2\T, 
Ro + R, + R2< I{U,- Y^\T, X^) + I{T, X^, U2; Y2) - I{U,- U2\T, X, 
2Ro + R, + R^< I{T, Ui- Y,\X,) + I{T, X,, U2; Y2) - I{U,- t/ajT, X 



Proof. We define 



Rq = Rq — Ai — A2, R'l = i?i + Ai, R'2 = R2 + A2 



(5) 



(6) 



where Ai > 0, A2 > 0, Ai + A2 < -Rq- The region 7^2 is obtained by inserting © into the 
bounds ((3)) and applying Fourier- Motzkin elimination to ehminate Ai and A2 from those 
bounds. □ 



Note that for TZi and TZ'^ in Theorem ^ the relay decodes and forwards only the common 
message Wq, i.e., the relay does not help forward W2- However, in Lemma ^ we move part 
of rate Rq to Ri or/and i?2, so the relay now forwards part of W2- 

The region TZ2 includes the following region that will be useful when we consider the 
semideterministic partially cooperative RBC in Sectional 

Theorem 3. The following is an achievable region for the partially cooperative RBC: 

U 

t, Ml, M2, x)p{yi, 2/2 ki, x) 

(-R01 -Ri) R2) '■ 

Ro >0,Ri> 0, R2 > 0, 
Ro < min {/(T; Y,\X,), I{T, X,- Y2)], 
Ro + R,<I{T,Ui;Y,\Xi), 
Ro + R2<HT,U2,X,-Y2), 

Ro + R, + R2< I{T, Ui; Fi|Xi) + /([/s; Y2\T, Xi) 
Ro + R, + R2< I{U,- Y^\T, X^) + I{T, X^, U2; Y2) 



(7) 



/(t/i;f/2|r,Xi) 
-I{U^■U2\T,X,] 



Proof. The achievability of TZ^ follows from the achievability of 7^2 by observing that any 
rate triple that satisfies the bounds in TZs also satisfies the bounds in 7l2- In particular, the 
addition of the first bound on Rq in TZ^ (the first term in the "min" ) with the last bound on 
i?o + -Ri + R2 in ^3 implies the last bound in 7^.2. An alternative proof of the achievability of 
7^3 is given in Appendix O where TZ^ is derived from the region 7Z[. This alternative proof 
exploits the geometric structure of 7^3. □ 
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Remark 1. The region TZ^ reduces to Marion's region for the broadcast channel (see ^ 
Theorem 2] and Ulk P. 391, Prob. 10(c)]). This can be seen by setting Xi = (f) in 71^, i.e., 
disable the relay function for destination 1. 

Remark 2. The region TZ^ reduces to the achievable rate of a partial decode- and- forward 
scheme for the relay channel given in 0/. This can be seen by setting Rq = and Ri = 0, 
and choosing Ui = T and U2 = X in The resulting bound is 

i?2 < max mill X; Y2), /(T; Y^\X^) + I{X; ^2!^, Xi)} (8) 

where the maximum is taken over the joint distributions p{t, xi, x)p{yi, y2\xi, x) . 



We next provide an outer bound on the capacity region. 



Theorem 4. The following is an outer bound on the capacity region of the partially cooper- 
ative RBC: 

n= u 

(-R01 Ri,R2) '■ 
Ro >0,Ri> 0, R2 > 0, 
Ro < min {/(T; Yi\X,),I{T, X^- Y2)] , 
Ro + R,<I{X-Y,\X^), 

Ro + R2< min { J(T, U, X,; ^2), /(X, X^■, Y2)}, 
R, + R^ + R2< I{T; Y,\X,) + /(X; Y,\T, U, X^) + I{U; Y2\T, X,), 
Ro + Ri + R2< I{X; Y,\T, U, X,) + I{T, U, X,- Y2), 
[ R, + R^ + R2<I{X-Y,,Y2\X^) 

where the joint distribution p{t,u,xi,x,yi,y2) satisfies the Markov chain condition: 

{T,U)^{X,,X,Y^)^Y2. (10) 



(9) 



Proof. See Appendix iBl 



□ 



Remark 3. The region TZ is convex. In fact, the random variable Q defined at the end of 
AppendixWi can be viewed as a time-sharing random variable. 

Remark 4. The joint distribution p{t, u, Xi, x, yi, 1/2) of the random variables in Theorem^ 
does not necessarily satisfy the Markov chain condition: 

{T,U)^{X,,X)^{Y,,Y2). (11) 

Remark 5. The outer bound TZ is at least as good as cut-set bounds, and sometimes tighter. 
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3.1 New Bounds for Broadcast Channels 



The capacity region of the discrete memoryless broadcast channel is still unknown. Inner 
and outer bounds have been obtained in, e.g., [T31[71[TH], and e.g., [HIH], respectively. We 
provide new inner and outer bounds derived from Theorems |21 and |31 respectively. 

Theorem 5. The following is an inner bound on the capacity region of the broadcast channel: 

n2,Bc = U 

p{t,ui,U2,x)p{yi,y2\x) 

' {Ro, Ri, R2) ■.Ro>0,Ri> 0, i?2 > 0, 
Ro + Ri<I{T,Ui;Yi), (12) 
Ro + R2<I{T,U2;Y2), 

Ro + Ri + R2< I{T, Ui- Fi) + /(f/2; Y2\T) - I{Ui- U2\T), 
Ro + Ri + R2< Yi\T) + liT, U2; F2) - /(f/i; ^2!^), 
2i?o + Ri + R2< I{T, Ui; Yi) + /(T, U2; Y2) - liUi, U2\T) 



Proof. The proof follows by setting Xi 



in Theorem 121 



□ 



Among the inner bounds that have been obtained for the broadcast channel so far, Marton's 
region given in [71 Theorem 2] and P. 391, Prob. 10(c)] is the largest, and is sometimes 
conjectured to be the capacity region. Note that Marton's region can be derived from TZ^ 
in Theorem 121 (see Remark^. Comparing Theorem El with Marton's region in P. 391, 
Prob. 10(c)], we can make the following formal remark. 

Remark 6. The inner bound 7^2, bc includes Marton's region. We do not know if 7^2,30 is 
strictly larger, however. 



The following outer bound TZbc for the broadcast channel can be specialized from the 
outer bound TZ in Theorem HI 

Theorem 6. The following is an outer bound on the capacity region of the broadcast channel: 

nBC= U 

p{t,u,v,x)p{yi,y2\x) 

{Ro, Ri, R2) : i?o > 0, i?i > 0, R2 > 0, 
Ro<mm{l{T;Yi),I{T;Y2)}, 
Ro + R,<I{X;Y^), 

R, + R2<I{T,U-Y2), (13) 
R, + R^ + R2< I{T; Y,) + I{X; Y^\T, U) + I{U; Y2\T), 
R^ + Ri + R2< I{T, U; K,) + I{X; Y,\T, U), 
Ro + Ri<IiT, V;Y,), 
R^ + R2<I{X;Y2), 

R^ + R^ + R2< I{T, V- Y^) + I{X; Y2\T, V), 
Ro + Ri + R2< I{T- Y2) + I{y- FilT) + /(X; Y2\T, V) 
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Proof. The first five nontrivial bounds can be obtained from Tlieorem E] by setting Xi = (p. 
The last four bounds can be obtained by switcliing tfie roles of destinations 1 and 2. Note 
tliat tlie joint distribution p{t, u, v, x, yi, 1/2) satisfies tfie Markov cliain condition: 

{T,U,V)^X^{Y,,Y2). (14) 

One can clieck tliis condition by referring to tlie proof of TlieoremU] given in Appendix^ □ 

Remark 7. The outer bound TZbc reduces to the outer hound in Theorem 5] for the 
broadcast channel with only private message sets. It also reduces to the outer hound in 0/ 
for the semideterministic broadcast channel with both a common message and two private 
messages. Note that our proof is simpler than the proof given in that was based on a 
recursive approach. 

Remark 8. The outer bound TZbc gives the capacity region for the more capable broadcast 
channel studied in fW^ . 



4 Partially Cooperative RBCs with Degraded Message 
Sets 

In tliis section, we consider tlie partially cooperative RBC with degraded message sets where 
i?2 = (see Fig. El). We derive the following inner and outer bounds on the capacity region. 



* X Y, 

W^Wi^Sms Esse — 



Figure 3: Partially cooperative RBC with degraded message sets 



Theorem 7. The capacity region Cdm of the partially cooperative RBC with degraded message 
sets satisfies 



Cdm^ (J 'Jz(^p{t,xi,x,yi,y2)^ 

p{t,xi ,x,yi,y2)=p{t,xi ,x)p(yi ,y2 \x,xi) 

Cdm^ U n(^p{t,xi,x,yi,y2 



(15) 

R[p{t,xi,x,yi,y2)j 

p{t,xi ,x,yi ,y2)=p{t,xi ,x,yi)p{y2 \yi ,x,xi) 
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where 



n(p{t,xi,x,yuy2) 



{Rq, Ri) : 

Ro > 0, i?i > 0, 

Ro<I{T,X,;Y2), 

R^ + R,<I{X;Yi\X,), 

Ro + R,<I{X;Y,\T,Xi] 



(16) 



nT,X^■,Y,) 



Proof. The inner bound follows from Theorem |21 by setting R2 = and choosing Ui = X and 
U2 = T. To derive the outer bound, we use Theorem HI The first and second bounds in (fT^ 
follow from the respective first and second bounds in (jH)). The third bound in (fTBj) follows 
by setting i?2 = in Theorem |3 and writing (T, U) as T for the fifth bound in 0. □ 

Remark 9. The inner and outer bounds given in Theorem^ have the same form except that 
the joint distribution p{t, xi, x, 2/1,1/2) satisfies different Markov chains. 



5 Semideterministic Partially Cooperative RBCs 

In this section, we specialize our theory to semideterministic partially cooperative RBCs (see 
Fig. HI). 

Definition 1. A partially cooperative RBC is semideterministic if the transition probability 
distribution p{yi\x,xi) takes on the values or 1 only. The channel is deterministic if 
p{yi,y2\x,Xi) takes on the values or 1 only. 




Figure 4: Semideterministic partially cooperative RBC 
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Theorem 8. The capacity region of the semideterministic partially cooperative RBC is 



Csd= U 

p{t,u,xi,x)p{yi,y2\x,xi) 
{Rq, Ri, R2) ■ 

Ro < min {/(T; Y,\Xi), I{T, X^, Y^)}, 
Ro + Ri<H{Y,\X,), 
Ro + R2<HT,U,Xi;Y2), 

Ro + Ri + R2< I{T- FilXi) + H{Y^\T, U,X,) + I(U- Y^lT.X^) 
Ro + Ri + R2< H{Y,\T, U, X^) + /(T, Xi, U- Y2) 



(17) 



Proof. Achievability follows from Theorem El by setting Ui = Yi, redefining U2 = U, and 
using H{Yi\Xi, X) = 0. The converse follows from Theorem 0] by using H{Yi\Xi, X) = 0. 
We are left to show that the joint distribution p{t, u, Xi,x, yi, 2/2) for the outer bound satisfies 
the Markov chain condition: 



iT,U)^{X^,X)^{Y^,Y2). (18) 
This condition follows from the proof of Theorem 0] given in Appendix El D 

Remark 10. Theorem \^ reduces to the capacity region of the semideterministic broadcast 
channel given in ^] by setting Xi = (p. 

Remark 11. Theorem\^ reduces to the capacity of the semideterministic relay channel given 
in |2f by setting Rq = 0, Ri = 0, T = Yi, and U = X . 



It is now easy to derive the following capacity region from Theorem |H1 
Corollary 1. The capacity region of the deterministic partially cooperative RBC is 

U 

p{t,xi,x)p{yi,y2\x,xi) 
{Ro, Ri, R2) : 

-Ro > 0, /?i > 0, R2 > 0, 

Ro<mm{I{T■,Y^\X^),I{T,X,■,Y2)}, 
Ro + Ri<H{Yi\Xi), 
Ro + R2<H{Y2), 

Ro + Ri + R2< I{T- FilXi) + //(Fi, Y2\T, Xi) 
Ro + Ri + R2< I{T, X,- Y2) + H{Yr, Y2\T, X^) 



(19) 



Proof. Achievability follows by setting [/ = I2 in Theorem |H1 To prove the converse, consider 
Theorem m and note that the first two bounds in ()19p follow from the first two bounds in Q 
by using H{Yi\Xi, X) = 0. The third bound in (jl9j) follows from the third bound in Q by 
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(20) 



using H(Y2\Xi, X) = 0. We next use the fourth bound in and obtain the fourth bound 
in (HH): 

Ro + Ri + R2< I{T; yilXi) + I{X; Yi\T, U, X^) + I{U; Y^lT, X^) 

< I{T- FilXi) + I{X- Fi, Y2\T, [/, Xi) + I{U- Fi, FalT, X^) 
= /(T; FilXi) + J(X, [/; Fi, F2IT, Xi) 
= IiT;Y^\X,) + HiY^,Y2\T,X,) 

where the last step follows by using H(Yi, Y2\Xi, X) = 0. 
Finally, we use the fifth bound in © and obtain the fifth bound in p9|) : 

Ro + Ri + R2< I{X; Yi\T, U, X^) + I{T, U, X^; Y2) 

< I{X- FilT, U, Xi) + I{U- Y2\T, Xi) + /(T, X^- Y2) 

< I{X; Fi, Y2\T, f/, Xi) + I{U; Y,, Y2\T, Xi) + I{T, Xv, F2) 

< /(X, U; Fi, F2IT, Xi) + I{T, Xi; F2) 
<i/(Fi,F2|T,Xi) + /(T,Xi;F2). 

□ 



(21) 



Corollary ^ has an especially simple form when Rq = 0. 
Corollary 2. The capacity region of the deterministic partially cooperative RBC with Rq = 



IS 



U 

p{yi,y2\x,xi) 



{ {Ri,R2): 

Ri >0,R2> 0, 
Ri < H{Y,\X,), > . 

R2<H{Y2), 

[ R, + R2<H{Y,,Y2\X,) J 



(22) 



Proof. Achievability follows by setting T 
follows from cut-set bounds. 



and i?o = in Corollary ^ The converse 

□ 



We now consider an example channel that we call the Blackwell partially cooperative RBC. 

Example 1. Suppose the channel from the source to destinations 1 and 2 is the Blackwell 
broadcast channel with the channel depicted in Fig. [31 Suppose further that the 

channel from destination 1 to destination 2 is orthogonal to the channel from the source to 
destinations 1 and 2, and is deterministic with capacity r (see Fig. We refer to this 
channel as the Blackwell partially cooperative RBC. 

Suppose that Rq = 0. From Corollary |2l we obtain the following bounds: 

Ri < H{Y,) 



R2 < H{Y2) < H{Y2i) + //(F22) 

Ri + R2<H{Yi,Y2\X{) = H{Yi,Y2i,Y22\Xi] 

= H{Y,,Y2i\X,) <H{Y,,Y2i) 



(23) 
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IM 




Figure 5: Blackwell partially cooperative RBC 



where (a) and (b) are equalities if and only if X is independent of Xi. It is clear that the 
input distributions p{x,xi) that achieve capacity boundary points have X independent of 
Xi. We parameterize the distribution of X as follows: 

Pr{X = 0} = a, Pr{X = l} = p, Pr{X = 2} = 1 - a - P (24) 

where a > 0, /3 > and a + P < 1. Inserting into (j2Sl), we obtain the capacity region 
for the Blackwell partially cooperative RBC: 

i?2) : 
Ri >0,R2> 0, 
Ri < h{f3), 
R2 < r + h{a), 
Ri + R2 < —a log a — (3 log /? 

-(1 -a-/3)log(l 



C 



Bw,RBC 



U 

a > 0,/5 > 0, 



(25) 



where h{x) 



-x\ogx — {1 — x) log(l 



X] 



If destination 1 does not relay information for destination 2, the RBC reduces to the 
Blackwell broadcast channel. In this case, the region reduces to (see [221 ) 

(i?i, R2) : 
Ri > 0,i?2 > 0, 
Ri < K(3), 
R2 < h{a), 

Ri + R2 < —a log a — log /5 

-(1 - a-/5) log(l - a-/5) 



C 



Bw,BC 



U 

a>0,/3> 0, 
a + < 1 



> . 



(26) 



We compare the capacity region ()25p for different r in Fig. |B1 (the capacity region of the 
Blackwell broadcast channel ()26p is given by the dashed curve labelled r = 0). From this 
figure, it is clear that relaying improves rates by enlarging the bound on R2 in (j25p . The 
capacity region grows as r increases because the relay is able to transmit more information 
to destination 2. 
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Figure 6: Capacity region of the Blackwell partially cooperative RBC 

6 Orthogonal Partially Cooperative RBCs 

In this section, we study the orthogonal partially cooperative RBC where the relay (desti- 
nation 1) has the practical constraint that it must transmit and receive in two orthogonal 
channels. The channel model is illustrated in Fig. [7|and is defined as follows. 

Definition 2. An orthogonal partially cooperative RBC consists of two source input alphabets 
Xji and Xd, a relay input alphabet X\, two channel output alphabets and 3^2? md a 
transition probability distribution 



p{yi,y2\xR, xd, xi) = p{yi\xR, xi)p{y2\xD, xi). 



(27) 



Note that this model reduces to the relay channel with orthogonal components studied in 
PH] if the source has only a private message W2 for destination 2. We have the following 
capacity theorem. 
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X. 



X 



> Y, 



Figure 7: Orthogonal partially cooperative RBC 



Theorem 9. The capacity region of the orthogonal partially cooperative RBC is 

{Rq, Ri, R2) : 

^0 >0,Ri> 0,i?2 > 0, 
Cor= U < Ro + Ri<nXR;Y,\X,), 

p{xi)p{xr\xi)p{xd\xi) Ro + R2< I{Xd,Xi;Y2), 
Piyi\xR,Xi)p{y2\xD,Xi) [ Ro + Ri + R2 < HXr;Yi\Xi) + I{Xd;Y2\Xi) 



(28) 



Proof. To prove achievability, consider Theorem |21 and set T = 0, Ui = Xr, and U2 = X^,. 
We further choose Xi^, xd) = p{xi)p{xr\xi)p{x£i\xi). The first, second and third bounds 
in (0) provide the achievable region, and the other two bounds in ((3)) are implied by these 
three bounds. The converse follows from cut-set bounds. □ 



An alternative proof of achievability is provided in Appendix O From this proof, we see 
that the source does not apply superposition encoding or binning, and that block Markov 
encoding is not necessary. Hence, the code construction and encoding is much simpler for 
the orthogonal partially cooperative RBC than for a general partially cooperative RBC. 

Remark 12. Theorem{^ reduces to the capacity of the relay channel with orthogonal com- 
ponents given in '^101. The result is 

R2 < mm{I{Xn, X^, Y2)J{Xr- Yi\X^) + I{Xd] 1^2|^i)}. (29) 
We next consider the Gaussian orthogonal partially cooperative RBC with channel outputs 



Yi=Xr + Z^ 

30 

Y2=Xd + Xi + Z2 ^ ' 

where Zi and Z2 are independent, zero mean, Gaussian random variables with variances A^i 
and iV2, respectively. The channel input sequences {{xR^i,XD,i)} and {xi^i} are subject to 
the following average power constraints: 

ljl^[Xh + Xl,]<P, and lj2^[Xl]<Pr. (31) 
1=1 1=1 
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The capacity region for this channel is as follows. 

Corollary 3. The capacity region for the Gaussian orthogonal partially cooperative RBC is 

{Rq, Ri, R2) ■ 
Ro >0,Ri> 0, i?2 > 0, 

Ro + Ri<c(^^ 



Ccor — [J 

a,/36[0,l] 



N2 



(32) 



where C{x) = \ log(l + x). 
Proof. The proof is a simple extension of Theorem El and is omitted. 



□ 



7 Parallel Partially Cooperative RBCs with Unmatched 
Degraded Subchannels 

In this section, we consider the parallel partially cooperative RBC with unmatched degraded 
subchannels. This channel includes two partially cooperative RBCs (subchannels I and II) 
with communication links in two channels orthogonal to each other. Moreover, the output 
of destination 2 is a degraded version of the output of destination 1 in subchannel I, and the 
output of destination 1 is a degraded version of the output of destination 2 in subchannel 
II. The channel model is illustrated in Fig. IHland is defined as follows. 




X, 



'Souce 



Figure 8: Parallel partially cooperative RBC with unmatched degraded subchannels 



Definition 3. A parallel partially cooperative RBC with unmatched degraded subchannels 
has a vector source input alphabet {Xa,Xb), a vector relay input alphabet {Xia,Xih), two 
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vector output alphabets (3^ia,3^ib) and (3^201^26); <ind a transition probability distribution: 

PiUla, y2a\Xa, Xia)p{yib, y2b\Xb, Xu) 

that satisfies the following two degradedness conditions: 



PiVla, y2a\Xa, Xia) = p{yia\Xa, Xia)p{y2a\ yiai X\a 

piyib, y2b\xb, xib) = p{y2b\xb, xib)p{yib\y2b, xu) 



(33) 



Note that the parallel partially cooperative RBC with unmatched degraded subchannels 
is not a degraded partially cooperative RBC, although both subchannels are degraded. We 
obtain the following bounds on the capacity region. 

Theorem 10. An achievable region for the parallel partially cooperative RBC with un- 
matched degraded subchannels is 



TZ = 



f/lfei y2b\Xb-, Xib) 



(34) 



> . 



U 

p{ta, Xa, Xia)p{tb, Xb, Xib)p{yia, y2a\Xa, Xia)p{y 

{Rq, Ri, R2) : 
^0 > 0, i?i > 0, R2 > 0, 

Rq < H'^ai yial^la) + liTb'i Ylbl^lb), 
RO < I{Ta, X,a, Y2a) + I{Tb, X.b, Y^b) , 
' R0 + Rl< I{Xa; Yla\Xia) + HTb, Yu\Xu), 
Rq + R2 < I(Ta, Xia] Y2a) + I{Xb, Xib] ^2^), 

R0 + Rl + R2< HXa, Yia\Xia) + I{Tb] Flfe|Xib) + I{Xb] Y2b\Tb, Xib). 
^ Ro + Rl + R2 < I{Xa] Yia\Ta., Xia) + /(T^, Xia] l2a) + I{Xb-, Xib] ^26. 

An outer bound on the capacity region is 

n = II 

P{Xa, Xia)p{Xb, Xib)p{yia, y2a\Xa, Xia)p{yib, y2b\Xb, Xib) 

{Rq, Rl, R2) '■ 
Ro >0,Ri> 0, i?2 > 0, 

Ro + Ri< I{Xa] YialXia) + I{X,] Yi,\Xi,), 
Rq + R2 < I{Xa: Xia] ^2a) + I{Xb-, Xn,] 1^26), 
[R^ + Rl+R2< I{Xa] Yia\Xia) + I{Xb] Y2b\Xib) 



Proof. The inner bound follows by choosing Yi = {Yia,Yib), Y2 = {Y2a,Y2b), T = {Ta,Tb), 
Ui = Xa and U2 = Xb in Theorem IHl and by assuming that {Ta, Xa, Xia) is independent of 
(Tfe, Xb, Xib). The outer bound follows from cut-set bounds and the degradedness conditions 

dsii). □ 

Remark 13. The region TZpara in TheoremM (A reduces to the capacity region of the product 
of two unmatched degraded broadcast channels given in 11^ . 



(35) 
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In general, the inner and outer bounds given in Theorem do not match. We next 
consider three cases of this channel where the source has different message sets for the two 
destinations. Case 1 has R2 = 0, i.e., the source has a common message Wo for both 
destinations and a private message Wi for destination 1. We obtain the following capacity 
region for this case. 

Theorem 11. For the parallel partially cooperative RBC with unmatched degraded subchan- 
nels where R2 = 0, the capacity region is 

C' = II 

para 

pit, Xa, Xia)p{Xb, Xib)p{yia, y2a\Xa, Xia)p{yib, y2b\Xb, Xib) 
(Rq, Ri) : 

Ro >0,Ri> 0, 

Rq < I(T^ -^la] ^2a) + H-^b, ^Ib] ^2b) , 

[ R^ + R, + R2< I{Xa; FialT, X,,) + I{T, X^,; Y^a) + I{Xb, X^, Y^b) 



(36) 
> . 



Proof. To prove achievability, we use (fTHj) in Theorem [7| with T = {Ta,Xb), X = {Xa,Xb), 
Yi = (Yia,Yib) and Y2 = (^20,^2?)), and assume (Ta,Xa,Xia) is independent of {Xb,Xib). 
For notational convenience, we finally replace with T. The converse is given in Appendix 

E □ 

We now consider case 2, where Rq = and Ri = 0, i.e., the source has only a private 
message W2 for destination 2. The channel in this case reduces to the parallel relay channel 
with unmatched degraded subchannels. Note that this relay channel is not degraded as 
defined in 0. We obtain the following capacity result. 

Theorem 12. The capacity of the parallel relay channel with unmatched degraded subchan- 
nels is 



Cii^^ = maxmin{/(Xa, Xia, F2a) + HXb, X^, Y2 



2b 



(37) 



I{Xa-, Yla\Xia) + I{Xb] Y2b\Xib)} . 

where the maximum is taken over all joint distributions 

p{Xa, Xia)p{Xb, Xib)p{yia, y2a\Xa, Xia)p{yib, y2b\Xb, Xu). 

Proof. Achievability follows by setting Rq = and Ri = and choosing = Xa, Tb = (p 
in (I34j) in Theorem The converse follows by setting Rq = and i?i = in the last two 
bounds in (jHHjl . □ 



Remark 14. Theoremu^ establishes the capacity for a new class of relay channels. 

Note that the capacity C of the point-to-point parallel channel with two subchannels is 
C = Ca + Cb if the capacities of the two subchannels are Ca and Cb, respectively. However, 
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this is not true for the parallel relay channel. To see this, observe that the capacities of the 
two degraded relay subchannels are (see |3j): 



Ca = max mm{I{Xa,Xia;Y2a),I{Xa;Yia\Xia)} 

PyXa, XlajpiVla, ?/2aFa, Xia) 

Cb= max I{Xh;Y2b\Xih). 

p{xb, xib)p{yib, y2b\xb, xib) 

But the sum of Ca and Cb in (IHHl) is 



(38) 



Ca + Cb = maxmin{J(X„, Xi,; Faa) + I{Xb; Y2b\Xu), 

liXa; Y^a\X,a) + nXb, Y2b\Xib)} (39) 

— para 

where the maximum is taken over all joint distributions 

PiXa, Xia)p(Xb, Xib)p{yia, y2a\Xa, Xla)p{yib, y2b\Xb, Xu)- 

Remark 15. The capacity of the parallel relay channel with two subchannels can be larger 
than the sum of the capacities of the two subchannels. 



Intuitively, Remark 1131 follows because information transmitted over the two subchannels 
may not be independent as in the point-to-point parallel channel with two subchannels. As 
we show in the following example, information forwarded from the source to the relay in one 
subchannel may be forwarded from the relay to the destination in the other subchannel. 

Example 2. Consider the two subchannels shown in Fig. and suppose all channel input 
and output alphabets are {0, 1}. 




Y,t=0 X,, 



^ > ^-^21,- X^i, 



Figure 9: An example of parallel relay channel with unmatched degraded subchannels 



One can check that subchannel I is degraded with capacity Ca = 0, and subchannel 11 
is reversely degraded with capacity Cb = 0. However, by ^7\i the capacity of the parallel 
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relay channel is C^f^^ = 1 that is larger than + Cb. This capacity is achieved by having 
the source node forward 1 bit per channel use to the relay over subchannel I, and the relay 
forward 1 bit per channel use to the destination node over subchannel II. 

Finally, consider case 3 where Rq = 0, i.e., the source has private messages Wi and W2 for 
destinations 1 and 2, respectively. 

Corollary 4. For the parallel partially cooperative RBC with unmatched degraded subchan- 
nels where Rq = 0, an achievable region is 



III 



para l^_J 

p{ta, Xa, Xi^a)p{tb, Xb, Xifi)p{yi^a, y2,a\Xa, Xi^a)p{yi,b, y2,b\Xb, Xi^b) 

(i?0) Rl-, R2) '■ 

Ro >0,Ri> 0,i?2 > 0, 

i?l < liXa, Flal^la) + I (T,; Yi,\Xi,), 
R2 < I{Ta, Xia, Y2a) + I{Xt, Xih, Y2b), 

Rl+R2< I{Xa; Yia\Xia) + I{T,- Yi,\Xi,) + I{X,- Y2b\%, Xi,) 

[ R, + R2 < I{Xa;Yia\Ta,Xia) + I{n,X,a-Y2a) + I{Xb,Xu;Y2b) J 



> . 



(40) 



Proof. The result follows directly from Theorem ITUl 



□ 



Note that the two subchannels in Corollary 0] are the degraded RBC with the capacity 
region given in P] and the reversely degraded RBC with the capacity region given in 
The capacity regions of the two subchannels are as follows: 



c.= U 

Pij^ai Xai Xia) 

p{yi ai y2a\Xai Xla) 



{Rl, R2) '■ 

Rl > 0,i?2 > 0, 

Rl < I{Xa]yia\Ta,Xia) 

R2 < min {/(r„ Xla, Y2a),I{Ta, Yia\Xia)} 



(41) 



and 



U 

p{tb,Xb,Xib) 



{Rl, R2) ■ 

Rl >0,R2> 0, 

Ri<I{n;Yi,\Xu) 
R2 < I{Xh; Y2b\Tb, Xib) 



p{yib,y2b\xb,xib) 

The Minkowski sum of the preceding two capacity regions is given by 



C-a + Cb 



{Rl, R2) : -Rl — -Rla + -Rib, R2 — R2a + -R26, 

where (-Ria, R2a) e C (-R16, -R26) G Cb 



From the preceding relay channel example, it is clear that, in general, we have 

Ca ~\~ Cb CI Rpi^^g^. 



(42) 



(43) 



(44) 



We hence make the following remark. 
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Remark 16. The achievable region of the parallel partially cooperative RBC with unmatched 
degraded subchannels where Rq = can be larger than the Minkowski sum of the capacity 
regions of the two subchannels. This is in contrast to the parallel broadcast channel with 
unmatched degraded subchannels and Rq = 0, where the capacity region equals the Minkowski 
sum of the capacity regions of the two subchannels U^ . 

8 Conclusions 

We derived new inner and outer bounds on the capacity region of the discrete memoryless 
partially cooperative RBC. The inner bounds are based on the source using superposition 
encoding and binning, and the relay using decode-and-forward for the common message and 
partial decode-and-forward for the private message for destination 2. Our outer bound on 
the capacity region uses a more general and simpler approach than the recursive approach of 
Gel'fand and Pinsker for semideterministic broadcast channels. Based on our inner and outer 
bounds, we established the capacity regions for the semideterministic partially cooperative 
RBC, the orthogonal partially cooperative RBC, and the parallel partially cooperative RBC 
with unmatched degraded subchannels where i?2 = 0. We also established the capacity 
region for the parallel relay channel with unmatched degraded subchannels. 

Our inner and outer bounds can be specialized to new bounds for the broadcast channel. 
By letting relay inputs be null, our inner bound reduces to a region that includes Marton's 
inner bound. Our outer bound reduces to a new capacity outer bound for the broadcast 
channel that generalizes Marton's outer bound to include a common message, and generalizes 
Gel'fand and Pinsker's outer bound to the general discrete memoryless broadcast channel. 



Appendix 

A Proof of Achievability for IZ'^ in Theorem [T] 

Suppose the source uses superposition encoding and binning, and destination 1 (the relay) 
uses the decode-and-forward scheme for the common message Wq. We adopt the regular 
encoding/sliding window decoding strategy [23] for the decode-and-forward scheme (see [HI 
Sec. I] for a review of relaying strategies). 

We transmit in B blocks that each have length n (for convenience, we use the same notation 
for the block length as in Sec. |21even though transmission is here done in smaller blocks). 
During each of the first B — 1 blocks, a message tuple {WQ,,Wu,W2i) e [l,2"^o] X [l,2"«i] x 
[1, 2"^2] is encoded and sent from the source node, where i denotes the index of the block and 
i = 1, 2, . . . , S — 1. The average rate triple (i?o^, i?2^) over B blocks approaches 

(i?o, Ri, R2) as S ^ 00. 
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We use random codes and fix a joint probability distribution 

p{xi)p{t\xi)p{ui,U2\xi, t)p{x\xi, t, ui, U2)piyi, y2\x, xi). (45) 

Let {Pxt^tUiU2XYiY2) denote the strongly jointly e-typical set (see [121 Sec. 1.2]) based on 
the distribution (ji^ . 

Random codebook generation: We generate two statistically independent codebooks (code- 
books 1 and 2) by following the steps outlined below twice. These two codebooks will be 
used for blocks with odd and even indices, respectively (see the encoding step) . 

1. Generate 2"^° independent identically distributed (i.i.d.) with distribution YYi=i Pi^u)- 
Index these codewords as x^{w'q), w'q G [1,2"-^'']. 

2. For each x"(wg), generate 2"^° i.i.d. t" with distribution nr=i ^'(^*l-^i«(''^o))- Index 
these codewords as t"'{w'Q,wo), wq G [1,2"-^'']. 

3. For each Xi{w'q) and f^WQ^Wo), generate 2'^(^i"'"^'i^ i.i.d. Ui with distribution 
T\A=iP{'^ii\U{w'Q,wo)^xii{w'Q)). Index these codewords as ^^(wo, tyo, "i^ii "f^i), "U^i ^ [1,2"^^] 
and vi G [l,2'^^'i]. 

4. For each x"(wq) and t"{w'Q,Wo), generate 2"(^-2+^2) i.i.d. U2 with distribution 
YYi=iPi'^2i\'ti{'w'Q,Wo),Xii{wQ)). Index these codewords as 'U2('"^0) ''^O) '"^2 1 "^2), ""^2 ^ [1,2"^^] 
and f2 G [l,2"-^2]. 

5. For each x^{w'Q),t"'{wQ,wo),u^{w'Q,WQ,wi,vi) and U2{w'q,wo,W2,V2), generate one x"' 
with distribution 

n 

]^p(Xi|Mii(t(;d, Wo,Wi,Vi), U2i{wQ, Wo,W2, V2),ti{wQ, Wo), Xii(Wo)). 
i=l 

Denote a;" by x"'{w'q, Wq, Wi, Vi,W2, V2). 

Encoding: We encode messages using codebooks 1 and 2, respectively, for blocks with 
odd and even indices. This is done because some of the decoding steps are performed 
jointly over two adjacent blocks, and having independent codebooks makes the error events 
corresponding to these blocks independent. The probabilities of these error events are thus 
easy to evaluate. 

At the beginning of block i, let (woi, wu, W2i) be the new message triple to be sent in block 
i, and (wofi-i], W2[i-i]) be the message triple sent in block i — 1. The source encoder 

first tries to find a pair {vu, V2i) such that 

(^x1{woli^l]),t'^{Woli^l],Woi),u1{Woli^l],Woi, Wu, Vu),U2{Wo[i-l],Woi, W2i, V2i)^ G (Px^TUiUi) ■ 

One can show that such a pair exists with high probability for sufficiently large n if (see 

m) 

R[ + R'2> I{UuU2\T,Xi). (46) 
The source then sends the codeword x"{wo[i-i], woi, wu, vu, W2i, V2i). 
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At the beginning of block i, destination 1 (the relay node) has decoded the message iyo[j-i] 
and transmits x"(iyo[j-i]). For convenience, we list the codewords that are sent in the first 
three blocks in Tabled 



Table 1: Codewords being sent to achieve TZ[ in Theorem^ 



block 1 


block 2 


block 3 


u'^{l,Woi,Wu,Vii) 
U^{l,Woi,W2l,V2l) 


Xi(woi) 

r {Woi,Wo2) 

U'^iWoi,Wo2,W22,V22) 


r iWo2,Wo3) 

U'1{W02,W03,W13,V13) 

U'^{W02,W03,W23,V23) 



Decoding: The decoding procedures at the end of block i are as follows: 

1. Destination 1 knows WQ[i^i] and declares the message pair (^wly^\wii) is sent if there is 
a unique triple {wl^j^ ,Wii,Vii^ such that 

One can show that the decoding error in this step is small for sufficiently large n if 

R, + R[<IiU^,Y,\T,X,) 

Ro + Ri + R[<I{T,Ui;Yi\Xi). ^ ' 

2. Destination 2 knows iyo[j-2] and decodes (uioti-i], W2[i-i]) based on the information 

■,(2) 



received in block i — 1 and block i. It declares that the message pair (^Wq^^_-^^, W2[i-i]) 
is sent if there is a unique tuple {'w'^^_^,W2[i--i],V2[i-i]) such that 

x1{wo[i^2]),t"' {wo[i^2],W^o[tl])^ «2 (wo[i-2] , W'ofi-l] ' ^2[i-l] , *2[i-l]) , ?/2[i-l]) ^ {Px^TU^Y^) , 

and (xr«li]),?/2") eT;(P;,,^J. 

One can show that the decoding error in this step is small for sufficiently large n if 

R2 + R!2<I{U2MT,X^) 

Ro + R2 + R'2<nT,Xi,U2;Y2). ^ ' 

Combining (jTTjl . and (jlSj) . we find that 7?.']^ is achievable. 
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B Proof of Theorem HI 



Consider a code with length n and average block error probability P^. The probability 
distribution on the joint ensemble space Wq x Wi x W2 x ^Y" x Af" x 3^" x is given by 



n 

= p{wo)p{wi)p{w2)p{x"\wo,wi,W2) JJ \fi{xii\yl~^)p{yu,y2i\xi,x 



1=1 



By Fano's inequality j211 Sec. 2.11], we have 

H{Wo\Y,^) < H{Wo, VTiln") < n{Ro + Ri)Pe + 1 := n6u 
HiWolY^"") < H{Wo, W2\Y^) < n{Ro + R2)Pe + 1 := n52 

where ^2 — ^ if Pe 0. Similarly, we have 

HiWilY^") < H{Wo,Wi\Y{') < n6i, 
H{W2\Y^) < H{Wo,W2\Y^) < n62. 

We define the following auxiliary random variables: 



We first bound the common rate Rq: 



nRo = H{Wo) = nWo; n") + H{Wo\Y,^) 
< I{Wo;Y{')+n6, 

n 

= J2HWo;Yu\Yr') + n6, 

i=l 
n 



1=1 



(c) " 



i=l 
n 



(J 

i=l 



Y,H{Yu\Xu)-H{Yu\Ti,Xu)+n5^ 

i=l 
n 

Y,I{T,\yu\Xu) + n5i 



i=l 



(49) 



(50) 



(51) 



Ti := (Wo,yr\F2[m])' forz = l,2,...,n; (52) 
Ui := (H^2,l^r\V'2?mi)' for 2 = 1, 2,..., n. (53) 



(54) 



where (a) follows from Fano's inequality in (jSHI), {h) follows because Xu is a function of 
(c) follows because conditioning does not increase entropy, and {d) follows from the 
definition of Tj given in ()52|). 
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We can similarly derive the following upper bound on Rq: 

nRo = H{Wo) = I{Wo; Y^') + H{Wo\Y;') 

n, 

i=l 
(a) ™ 

< J2 Ifiy2i\Y^[i-,i]) - HiY2i\Wo, Yt\ 1^2[i+i], ^h) + n52 (55) 

i=l 
n 

< H(Y2i) - H(Y2i\Ti, Xh) + n52 

i=l 

n 

= Y,HTi,Xu;Y2i)+n52. 
1=1 

where (a) follows because conditioning does not increase entropy. We now bound the sum 
rate Ro + Ri: 

nRo + nR, = H{Wo, W,) = I{Wo, 1^") + H{Wo, W,\Y,^) 
<IiWo,Wi;Y{') + n6i 

n 

i=l 
n 

J2 HWo, Wi; Yu\Yr\Xu) + nSi 

(56) 

< J2 H{Yu\Yl-\Xu) - H{Yu\Yl-\ W^, X,) + n5i 



i=l 
n 

(J 

i=l 



i=l 

n 



(ft) ,^ , 

< J2h{Yu\Xu) - H{Yu\Xu,X,)+n6, 
1=1 

n 

= J]j(X,;yH|XH) + n5i. 

i=l 

where (a) follows because Xn is a function of Y^'^, and (6) follows from the Markov chain 
condition {YI-\Wo,W,) ^ (Xh,X,) ^ Y,,. 
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We next derive an upper bound on the sum rate Rq + R2: 

riRo + nR2 = H{Wo, W2) = I{Wo, W2; Y^) + H{W^, W2\Y^) 
<I{W^.W2\Y^)^nb2 

n 

= Y.I{W,,W2.Y2,\Y^y,^,^+n52 

i=l 
(a) " 

< Y,H{Y2r)-H{Y2,\Wo,W2^Y^^,+^^,Yl-\Xy:) + n52 (57) 

i=l 
(6) ^ 

< H{Y2i) - H{Y2m. U^, Xu) + n62 
1=1 

n 

= J2HT^,U,,Xu■,Y2,)+n62 



1=1 



where (a) follows because conditioning does not increase entropy, and {b) follows from the 
definitions of Tj and Ui given in and (fSHj). respectively. We also have the following upper 
bound on the sum rate Rq + R2- 

nRo + nR2 = H{Wo, W2) = I{Wo, W2; 1^) + H{Wo, W2\Y^) 
<I{WQ,W2]Y^) + n52 

n 

= J2HWo,W2;Y2,\Yr') + nS2 

i=l 
n 

< J2 H{Y2^) - H{Y2i\Wo^ W2, Yt\Xu, Xi) + 1182 (58) 



i=l 



(a) 



< J2 H{Y2i) - H{Y24X,, Xu) + n62 

i=l 
n 

Y,nX^,X,f,Y2i) + n62 



i=l 

where (a) follows from the Markov chain condition (Wq, W2, ^2^^) ~^ i^Ui ^i) ^2i- 
We now introduce the following lemmas that will be useful for bounding the sum rate 

-Rq + -Rl + R2- 

Lemma 2. 

n n 

E/(i^2.;i^rWo,W^2,V'|,+i]) = E^(n.;i^|,+i]|W^o,W^2,i^r'), 

i=i ' ' i=i 

n n 



E nY2^■,Yr'\Wo,Y,l_^,]) = Enyu;Y2i^i]\Wo,Y^- 
i=i ' ' i=i 

Proof. See [23 Lemma 7]. □ 
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Lemma 3. 



i=l 

where Fio = 0. 

Proof. By direct calculation. □ 

Define 5 := 25i + 62. We obtain the following bound on Rq + Ri + R2: 

nRo+riRi + ni?2 

< I{W,- Y^) + I{Wi- Y^) + I{W2-^ Y^) + n5 

< I{W^- Y^) + /(I^i; Fi", 1^0, W^2) + /(1^2; >^2", W^o) + 

(a) (60) 

+ I{W2] Y^\Wq) - I{W2] Y^\Wq) + n6 
= /(PVo, W,, W2. Yl^) - /(M^2; niW^o) + /(W^2; l^alW^o) + nb 

where (a) follows because Wq, W\ and VF2 are independent. For the first term in (jHOl), we 
obtain the following bound: 

l{W^Wi.W2\Y^) 

n 

J2HWo,Wi,W2;Yu\YI-\Xi,) 

i=l 
n 

<Y,H{Yu\Xu) - H{Yu\Wo,WuW2,Yl~\Xu,Xi) 
1=1 

n 



i=l 



(61) 



(c) " 



n 



-^(^lil-'^ii) — H(Yii\Ti, Xii, Xi 

1=1 

n 



where (a) follows from the chain rule and because Xu is a function of 1^/"^, (6) follows from 
the Markov chain condition: (Wq, VFi, W2, F/""^) — > (Xii,Xj) — > Yij, and (c) follows because 
conditioning does not increase entropy. For the sum of the second and third terms in 
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we obtain the following bound: 
-I{W2-ynWo) + I{W2;Y^\Wo) 

n 



i=l 

J2 ~I{W2, F^.+i,; Yu\Wo, Yr') + IiY,l^,y,Yu\Wo, W^, Yf) 

i=l 
n 

^^Y,-HW2,Y,l^^,Y,,\Wo,Yr')+I{W2,Yr'-Y2^^^^^ 
1=1 

n 



= J2-ny2l+i]-,yu\Wo,YI-') - IiW2;Y,,\Wo,YI-\Y,l^,^,X,,) 
1=1 

+ I{Yt\ Y2^\W^, y^.+i]) + I{W2; Y2i\W^, 1"2[^+1], ^^'^ 

n 

(d) 



J2 -nW2; Yu\Wo, Yr\Y,l_^^,Xu) + IiW2; Y2,\Wo, Y,l^^,Yr\X 
1=1 

n 
i=l 



(62) 



where (a) follows from the chain rule, (6) follows from Lemma El (c) follows from the chain 
rule and the fact that Xu is a function of l^"^, (rf) follows from Lemma |2l and (e) follows 
from the definitions of Tj and Ui given in and (|^. respectively. 
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We substitute the bounds (|HT|) and into and obtain: 
nRo+nRi + ni?2 

n 

i=l 
n 

= J2 I{Tr\ Yu\Xu) + I{X,- Yu\T,, Xu) - I{U,; Y^m, Xu) 

i=l 

+ I{U,;Y2^m,Xu) + n6 

n 

= Y,KTuYu\Xu) + H{Y^.;\Ti,Xu) - H{Yu\Ti,Xu,X,) 

i=l 

- H{Yu\T,, Xu) + H{Yu\T,, X,,, U,) + I{Uf, Y^.lT,, Xu) 

n 

= J2HT^■,Yu\Xu) - H{Yu\T„Xu,X,) + HiYum,Xu,U,) 

i=l 

+ I{U,;Y2i\Ti,X^i) 

(a) " 

< HT^■, Yu\Xu) - H{Yum, Xu, X„ U,) + H{Yum, Xu, U{) 

i=l 

+ I{Uc,Y2m,Xu) + n6 

n 

= Y Yu\Xu) + /(X,; Yu\Ti, Xu, U,) + I{Uf, Y^^. ^u) + n5 
1=1 

where (a) follows because conditioning does not increase entropy. 
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We can also bound the sum rate Rq + Ri + R2 as follows: 

uRq + nRi + ni?2 

< I{W,; + I{Wo, W2; Y^) + n6 

< liW,; Wo, W2) + /(Wo, W2; Y^) + n5 
= I{W^- Y^\Wo, W2) + I{Wo, W2, 1^2") + n5 

n 
i=l 

71 

i=l 
n 

= J2 HWi; Yu\Wo, W2, Yr') + I{Wo, W2, Y^'; Y2^\Y^l^,^) 

i=l 

-I{Y^,;Y^l,^^\Wo,W2,Yr') + n^ 

n 

= J2 -HiYu\Wo, W2, W,, Y^') + I{Wo, W2, Yl-'; Y2,\Y,l^,]) 

i=l 

+ H{Y^,\Wo, W2, Yt\ Fsim]) + 

(c) ^ 

< J2 -H{Yu\Wo, W2, Wr, Yl-\ Xu, X,) + /(W^o, W2, Y^', Y^l^,^,Xu; ^2.) 

i=l 

+ H{Y^,\Wo, W2, Yl-\ F2[m]' + 

n 

-H{Yu\Wo, W2, Yr\ Xu, X,) + I{T„ U,, X^, ^2^) 

i=l 

+ H{Yu\Ti,Ui,Xu)+n5 

(e) " 

< Y -H{Yu\Wo, W2, Yt\ >^2[m]' X,) + /(T„ [/„ Xu, Y2i) 

i=l 

+ H{Yu\T,,Ui,Xri)+n5 

n 

= Y KXu Yv;\T,, U„ X^i) + I{T„ U„ X^f, Y2,) + nS 
1=1 

(64) 

where (a) follows from LemmaEl [b) follows from the chain rule, (c) follows because condition- 
ing does not increase entropy, because I {A; B\C) < I {A, C; B), and because Xu is a function 
of Yi-\ (d) follows from the Markov chain condition {Wq, W2, Y^-^) {Xu, Xi) Yu, 
and from the definitions of Tj and Ui, and (e) follows because conditioning does not increase 
entropy. 
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Finally, consider the following bound on Rq + Ri + R2: 

nRo+nRi + ni?2 

<I{W^,W,,W2;Y^,Y:^)+n5 

n 

= J2 HWo, W,, W2; Yu, Y2,\YI-\ y^i) + n6 
1=1 

n 

J2 HWo, Wi, W2; Yu, Y2,\Yt\ Y^-\Xu) + nS 



i=l 



<J2H{Yu,Y2,\Yr\Yr\Xu) ^^^^ 



i=l 

ri—l -lAJ— 1 



- H{Yu, Y2,\Wo, W^i, W2, Yl-\Yi-\ Xu, X.^ + nS 

(c) " 

< J2 H{Yu, Y2i\Xii) - H{Yu, Y2^\Xu, X,) + n6 

i=l 
n 

<Y,HX^■,Yu,Y2,\Xu)+n6. 

i=l 

where (a) follows because Xu is a function of Y^'^, (b) follows because conditioning does 
not increase entropy, and (c) follows from the Markov chain condition: 

{Wo,Wi,W2,YI-\Y^-') ^ {Xu,X,) ^ {Yu,Y2,). (66) 



Note that the random variables T", f/", X"', X", 1^^, 1^2" do not satisfy the Markov chain 
condition: (Ti,Ui) —>■ {Xii,Xi) — > (Yii,Y2i). This is because at time i, the current output 
Yii affects the future relay inputs X^^-_^^j, which affect the future outputs ^2"j+i] ^^^^ 
contained in random variables Tj and Ui. Hence Yu can be correlated with Tj and Ui 
even conditioned on the current inputs Xu and Xj. However, the Markov chain condition 
(Ti, Ui) {Xu, Xi, Yu) Y2i is satisfied. 

We now reduce the upper bounds to a single letter characterization. We introduce a random 
variable Q that is independent of Wo,Wi,W2, X"- , X^,Y{^ ,Y2 and is uniformly distributed 
over {1,2,..., n}. Define T = (Q, Tq), U = (Q, Uq), X = Xq, X, = Xig, Y^ = Y,q, and 
Y2 = Y2Q. By using these definitions, the bounds (j^ - (j3H|) and (jUHjl - ljU^ can be transformed 
into the single letter bounds in Theorem HI by following standard steps (e.g., Sec. HI]). 



C Proof of Achievability and Geometric Illustration 
for 7^3 in Theorem El 

Although the achievability of TZ^ can be directly seen from the achievability of 7^2 in Theorem 
El it is instructive to derive TZs from TZ[ in Theorem ^ by exploring the geometric structure 
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of 7^.3. In the following proof, we assume that I{T;Yi\Xi) < I{T, Xi;Y2). The case where 
/(T; Yi|Xi) > I{T,Xi] Y2) can be proved in a similar way as outlined below. 

The region TZ^ in Theorem El can have five possible structures (see Fig. [TUI) depending on 
how the bounds on the rates Rq, Rq + Ri, Rq + R2, and Rq + Ri + R2 compare with each 
other. We will show that the region corresponding to case 5 is achievable, where the bound 
on the sum rate Rq + Ri + R2 is larger than the bounds on Rq, Rq + Ri and Rq + R2. The 
achievability of the regions for the other four cases is either easy (binning is not necessary) 
or can be similarly proved. 




(M (M QbS 




We plot 7^3 corresponding to case 5 in more detail in Fig. El To prove this region is 
achievable, it suffices to show that the two corner points A and B are achievable. The rate 
triples in the rest of the region can then be achieved either by time-sharing or by switching 
part of Rq to Ri or R2 according to Lemma ^ 

The rate triple for corner point A is given by 

R^ = I{T;Y,\X,), 

i?^^ = /(f/i;Fi|r,Xi), (67) 
R^ = I{U2;Y2\T,X,) - I{U,;U2\T,X,). 



33 



HT-Y,\Xi) 




It is easy to check that this point is in TZ[ in Theorem 2] by choosing R[ = and R2 = 
I{Ui; U2\T,Xi). Hence the corner point A is achievable. 

The rate triple for corner point B is given by 
R^ = I{T■,Y^\X^), 

Rf = /(T, f/i; FilXi) - /(T, Xi; Y^) - I{Ui; U2\T, Xi), (68) 
R^ = I{T, U2, Xi; Y2) - I{T; Yi\X,). 

One can also check that the following rate triple is in 7l[ by choosing R[ = I{Ui; U2\T,Xi) 
and R'2 = 0: 

Ro = I{T,X^■Y2), 

Ri = I{T, Uu FilXi) - I{T, Xu Y2) - I{Ui- U2\T, Xi), (69) 
R2 = IiU2;Y2\T,X,). 

But the rate triple in (jUHj) can be expressed in terms of as {Rq , Rf , R2) = {Rq — 
S, Ri, R2 + S) where S = I(T, Xi, Y2) — I{T; Yi\Xi). Hence the corner point B is achievable 
by Lemma n in Section |21 

D Proof of Achievability for Theorem M 

Suppose destination 1 (the relay) uses the decode-and-forward scheme by forwarding only 
Wq. We transmit in B blocks that each have length n (we again use the same notation for 
the block length as in Section 12)). For the first B — 1 blocks, a message pair {Woi,Wii) G 



34 



[1,2"-'^°] X [l,2'^-^i] is encoded into a codeword and sent through the source-to-relay 
channel, where i denotes the index of the block and i = 1,2, ...,5 — 1. For the blocks 
indexed by i = 2, . . . , 5, a message pair (VFo[i_i], W2[i_i]) G [1, 2"-^°] x [1, 2^^^] is encoded into 
a codeword and sent through the channel from the source to destination 2. The average 
rate triple {Rq^ , , R2^) over B blocks approaches {Ro, Ri, R2) as B ^ 00. 

We use random codes and fix a probability distribution 

p{xi)p{xR\xi)p{xD\xi)p{yi\xR, xi)p{y2\xD, X2) . (70) 
We use {PxiXrXdYiY2) to denote the jointly e-typical set based on the distribution (fTUj). 
Random codebook generation: We generate a codebook as follows: 

1. Generate 2"^° i.i.d. x^ with distribution YYi=iPi^ii)- Index these codewords as x"(wg), 
w'f^ e [l,2"-^o]. 

2. For each Xi{wq), generate 2"(^"+-^i) i.i.d. with distribution YYi=iPi^Ri\^iii'^o))- 
Index these codewords as x]^{wq,Wo,Wi), Wq G [1,2"'^o] and Wi G [l,2"-^i]. 

3. For each x^^Wq), generate 2"^^ i i,^, with distribution YYi=iPi^Di\xii{u)'Q))- Index 
these codewords as x^{wq,W2), W2 G [l,2"'^2j^ 

Encoding: At the beginning of block i, the source sends x^(ti'o[i-i], "U^oi) Wu) and a;^(ti'o[j-i], W2[i-i])- 
The relay (destination 1) has decoded Wo[i-i] transmitted in the previous block. It then sends 
the codeword x"(iyo[j-i])- For convenience, we list the codewords that are sent in the first 
three blocks in Table |21 



Table 2: Codewords being sent to achieve Cor in Theorem IHl 



block 1 


block 2 


block 3 


x^(l) 

XR{l,Woi,Wn) 
xS(l,l) 


Xi^Woi) 

Xr{Woi,Wo2,Wi2) 
x'}j{woi,W2l) 


Xi{Wo2) 

X^(W02, W03,Wi3) 
Xd{wo2,W22) 



Decoding: The decoding procedures at the end of block i are as follows: 

1. Destination 1 knows ti'oii-i] ^i-nd declares the message pair (iDqP , is sent if there is 
a unique pair (lyoP ' such that 

One can show that the decoding error in this step is small for sufficiently large n if 

Ro + Ri<I{Xr-Y^\X^). (71) 
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2. Destination 2 declares that the message pair it'2[j-i]) is sent if there is a unique 



pair {w'^l_-^u W2[i-i]) such that 



^0[i-l] 



One can show that the decoding error in this step is small for sufficiently large n if 

R2<I{Xd;Y2\X^) 
Ro + R2<I{Xd,Xi;Y2). 

Combining ()7H1 and (f7^ . we find that the following region is achievable: 

{Rq, Ri, R2) : 



Kr= U 

p{xi)p{xii\xi)p{xd\xi) 
p{yi\xR,xi)p{y2\xD-,xi) 



Rq >0,Ri> 0,R2 > 0, 
Ro + Ri<IiXR;Y,\Xi). 
Ro + R2<I{Xd,Xi;Y2) 
[ R2<I{Xd;Y2\X,). 



(72) 



(73) 



We next show that the achievability of TZ'^.^ implies the achievability of Cor in Theorem 
El Suppose that {R'q, R[, R'^) G Cor] if R'2 < /(X^;y2|^i) then {R'q, R[, R'^) E Kr and this 
rate triple is hence achievable. If R'2 > /(^d; ^21-^^1)5 let R'2 = ^{Xd] 121-^1) + Note that 
< a < I{Xn; Yi\Xi) from Consider 



R'o + R', = IiXn■,Y^\X^)-^3, 



(74) 



so that a < /3 < /(X/?; Yi\Xi). We let Ro = R'o + a, Ri = R'^ and R2 = R'2 - a. We obtain 
the following bounds on {Rq, Ri, R2) based on the bounds on (i?Q, R'^, R'2): 

Ro + Ri = R'o + R'i + a = liXn; Y,\Xi) -/? + «< I{Xr; Yi\Xi), 



R2 = R'2-a = I{XD-,Y2\X{), 

Rq + R2 = R'o + R2 < IiXi,XD] Y2) 



(75) 



Hence we have {Rq, Ri, R2) G TZ'^^. and, according to Lemma HJ the rate tuple (-Rg, R'^, R'2) 
{Rq — a, Ri, R2 + a) is also achievable. This concludes our proof for the achievability of Co 



E Proof of Converse for Theorem [TTl 

Consider a code with length n and average block error probability Pe- The probability 
distribution on the joint ensemble space WqxWiX x x X]^^ x X]\^ x 3^"^ x 3^"^, x yi^^ x 3^26 
is given by 

P{Wq, Wi,x]^, X^, X\, Hi^, Hifj, y2a, y2b) 

= p{wo)p{wi)p{xl, x'i\wQ, Wi) 

n 

■ n [/- 

{XlaiWla^, Ulb^) fbi{Xibi\y\a^ , ulf, ^)p{yiai, y2ai\Xai, Xlai)piyibi, y2bi\Xbi, Xui) ■ 

i=l 

(76) 
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Note that the channels p{yiai, y2ai\xai, xiai) and p{yibi, y2bi\xbi, xibi) satisfy the degradedness 
conditions in (jHHj) . For convenience, we repeat these conditions here: 



) = Piyia\Xa,Xia)p{y2a\yia,Xla) 

p{yib, y2b\xb, xib) = p{y2b\xb, xib)p{yib\y2b, xu)- 



i=l 



j=i 



H-1 



(77) 



We define the following auxiliary random variables 

T, := (Wo, Yi-\ Yi^\ n-\Y;-'), for z = 1, 2, . . . , n. (78) 
Note that Tj satisfies the following Markov chain conditions: 

Ti — > {Xai, Xiai, Xbi, Xibi) (Yiai, l2ai, Yibi, Y2bi) , ioT i = 1,2, ... ,n. (79) 
We first bound the common rate Rq: 

nRo = HiWo) = liWo; Y^, Y^,) + H{Wo\Y^,, Y^,) 
<I{W^;Yl,Y^,)+n52 



(fe) - (80) 
< ^ //(y^a.) - H{Y2,^,W„ Yl-\ Yi-\ Yl^\ Y^^\X,^ 



+ H{Y2u) - H{Y2bi\Wo, Y^, Y^-^Xu, X^u) + nb-, 

(c) " 

< Xi,,; Y2ai) + H{Y2u) - H{Y2u\Xu, X^u) + 

1=1 

n 

= Y HTi, Xlai, Y2ai) + I{Xu, Xiu; Y2u) + n52 

i=l 

where (a) follows from Fano's inequality, [h) follows because conditioning does not increase 
entropy, (c) follows from the definition of Tj in (f7S|) and from the Markov chain conditions 

(Wo)^2a>^26 ^) ^ {^biiXibi) Y2bi- 



37 



We now bound the sum rate Ro + Ri. 
uRq + nRi 

= H{W^, W^) - /(Wo, W,- Y,l, Y;1) + H{Wo, W^\Y,l, Y^,) 
<I{Wo,Wi;Y,l,Y{l)+n5i 

n 

i=l 
n 



1=1 

n 



(81) 



< J2H{Yiai\X,ai) - H{Y,,i\Wo,W,,Yl-\Yl^\X 

laii 



i=l 



+ H{Y^u\X^u) - H{Y,,,\Wo, M^i, Y^, Yl^\X,u, X,,) + n5 



— ^ H(Yiai\Xiai) — H{Yiai\Xiai^ Xai) + //"(Fifti — H{Yi^\Xii,i, X^j) + n5i 

i=l 

n 

— ^ HXai', Y^lai\Xiai) + I{Xin\ 5^16i | -'^Ifei ) + n5i. 



where (a) follows from the chain rule and because {Xiai, Xn,i) is a function of (Yj*"^, y,*^"^), 
(6) follows because conditioning does not increase entropy, and (c) follows from the following 
Markov chain conditions: 



{Wo,W^,Yl-\Yl^') {X,,,X,a^) Y, 



laii 



(Wo, Yl,, Yl^') ^ (Xi,„ X^) ^ Fifti. 

We can also derive the following upper bound on the sum rate Rq + Ri. 
uRq + nRi 

= H{Wi) + H{Wo) 

< I{W^■ Y,l, Y{1) + I{Wo; Y,l, Y^^ + n5, + n5^ 

< I{W,; Y,l, Y,l, Y;1, Y^„ Wo) + I{Wo; Y,l, Y^,) + nS, + nS^ 

n 

— ^ I{Wi] Ylai, Y2ai, Yihi, Y2bi\Wo, Y^^ S ^2a ^ ^16 ^ ^26 ^) 
1=1 

+ I{Wo; Y^ai, Y2u\Y^-\Yi-^) + n5^ + nS^ 



(82) 



(a) 

< ^/(iyi;yi„,|T,,Xi„,) + 1(1^1; y2a»|r,,Fi„i,Xi„,) 

i=l 

+ I{Wi] Y2bi\Ti, Ylai, Y^ai, Xiiji) + liWi, Yiin\Ti, Ylai, l2aj, ^6i, Xibi) 

+ I{Wo; Y2ai\Y^-\Y^-') + I{Wo; Y^uVl,, Y^'^) + n^i + nh 

(b) " 

< yi{Wi;Y^jTi,X^J + I{Wi 

i=l 

+ /(Wo; >^2ai|1^4"\ y2b') + ^(W^O; 1^26^|>^2a, ^^4"') + ^Sl + 71^2 
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(83) 



where (a) follows from the chain rule and because {Xiai, Xi^i) is a deterministic function of 
(Y]*"^, l^r^)' (^) follows because the second and fourth terms in step (b) are zero due to 
the degradedness conditions given in ()77|) . The first term in the sum in fl83p can be bounded 
as 



I{W^■,Y^a^m,X,a^) 

< H(Yiai\Ti, Xiai) — H(Yiai\Wi,Ti, Xiai, Xai) 
(a) 

^ H{Yiai\Ti, Xiai) — H{Yiai\Ti, Xiai, Xai) 

< I {Xai', yiai\Ti, Xiai) 



^4) 



where (a) follows from the Markov chain condition (Wi, Ti) — > {Xai, ^lai) Yiai- The third 
term in the sum in (IH^ can be bounded as 



I{W,;Y,ai\Yi-\Yt' 



2b 

< I{Wo,Y|a\Y^a\Y|-\Y;,\Xla^■,Y2a^) (85) 
= I{Ti, Xiai', Y2ai) 

The sum of the second and fourth terms in the sum in ()83|1 can be bounded as 

I{Wi; Y2u\T^, Yla^, Y2a^, Xiu) + I{W^; Y2u\Yl, K;,-^) 

< I{Wi; Y2u\Wo, Yla, Yia, Yl^\ Y^,~\Xi^) 

+ I{Wo, y/^, Y^^^,Xibi; Y2bi\Y2a, ^2V^) 

= I{Wo, Wi, Yl, Yl,\ Xiu; Y,b^\Y^,, Y^,') (86) 

< H{Y2m) - H{Y2u\Wo, Wi, Yla, Ylb\yL. Yi^;\Xiu, X^i) 

= H{Y2bi) — H{Y2bi\Xi,i, Xibi) 
= I{Xbi, Xibi, Y2bi) 



where (a) follows from the Markov chain condition {Wq, Wi,Yi^, Y^^ > ^2ai ^26 ) ~^ {^bi, X 
Y^u- Substituting dHl, (|HS1), and dHHI) into (|HSI), we obtain 

n 

< I{Xai', Yiai\Ti, Xiai) + -^(^i, Xiai, ^2aj) + H^bi, Xibi] Y2u) + n5i + 71^2 



lU) 



(87) 



Finally, we note that all the terms in the bounds (jHUj) , ()8ip and ()87p are determined either 
by the distribution p{ti, Xai, xiai, yiai, y2ai) or by the distribution p{xbi, xm, ym, y2bi)- Hence 
there is no loss of generality to consider only joint distributions of the form p{ti, Xai, xiai)p{xbi, 

for {Ti , Xai , Xiai , Xbi , Xibi ) . 

The converse for Theorem ^2 now follows by using standard arguments (see the end of 
Appendix Eland e.g. [211 p. 402]). 



39 



Acknowledgement 



The authors would hke to thank Professor Venugopal Veeravalh for supporting Yingbin 
Liang's visit at Bell Labs in January 2005 where much of this work was performed. 



References 

[1] Y. Liang and V. V. Veeravalli. Cooperative relay broadcast chan- 

nels. Submitted to IEEE Trans. Inform. Theory, July 2005; available at 
Ihttp:// www.arxiv.org/PS_cache /cs /pdf/ 0605 / 06050 16.pdf 

[2] E. C. van der Meulen. Three-terminal communication channels. Adv. Appl. Prob., 3:120-154, 
1971. 

[3] T. M. Cover and A. A. El Gamal. Capacity theorems for the relay channel. IEEE Trans. 
Inform. Theory, 25(5):572-584, September 1979. 

[4] A. Reznik, S. Kulkarni, and S. Verdu. Broadcast-relay channel: capacity region bounds. In 
Proa. IEEE Int. Symp. Information Theory (ISIT), pages 820-824, Adelaide, Australia, 2005. 

[5] R. Dabora and S. Servetto. Broadcast channels with cooperating decoders. Submitted to 
IEEE Trans. Inform. Theory, May 2005. 

[6] G. Kramer, M. Gastpar, and P. Gupta. Cooperative strategies and capacity theorems for relay 
networks. IEEE Trans. Inform. Theory, 51(9):3037-3063, September 2005. 

[7] K. Marton. A coding theorem for the discrete memoryless broadcast channel. IEEE Trans. 
Inform. Theory, 25(3):306-311, May 1979. 

[8] S. I. Gel'fand and M. S. Pinsker. Capacity of a broadcast channel with one deterministic 
component. Probl. Inform. Transm., 16(l):17-25, Jan. -Mar. 1980. 

[9] A. A. El Gamal and M. Aref. The capacity of the semideterministic relay channel. IEEE 
Trans. Inform. Theory, 28(3):536-536, May 1982. 

[10] A. A. El Gamal and S. Zahedi. Capacity of a class of relay channels with orthogonal compo- 
nents. IEEE Trans. Inform. Theory, 51(5):1815-1817, May 2005. 

[11] G. Sh. Poltyrev. Carrying capacity for parallel broadcast channels with degraded components. 
Probl. Inform. Transm., 13(2):23-35, April- June 1977. 

[12] A. A. El Gamal. Capacity of the product and sum of two unmatched broadcast channels. 
Probl. Inform. Transm., 16(1):1-16, Jan. -Mar. 1980. 

[13] Y. Liang. Multiuser communications with relaying and user cooperation. Ph.D. disserta- 
tion. Department of Electrical and Computer Engineering, University of Illinois at Urbana- 
Champaign, Illinois, 2005. 

[14] T. M. Cover. Broadcast channels. IEEE Trans. Inform. Theory, 18(1):2-14, January 1972. 



40 



[15] P. P. Bergmans. Random coding theorem for broadcast channels with degraded components. 
IEEE Trans. Inform. Theory, 19(2): 197-207, March 1973. 

[16] A. A. El Gamal and E. C. van der Mculcn. A proof of Marton's coding theorems for the 
discrete memoryless broadcast channel. IEEE Trans. Inform. Theory, 27(1):120-122, January 
1981. 

[17] S. Lall. Advanced topics in computation for control. Lecture notes for Engr210b, Stanford 

University, Fall 2004. 

[18] B. E. Hajek and M. B. Pursley. Evaluation of an achievable rate region for the broadcast 
channel. IEEE Trans. Inform. Theory, 25(l):36-46, January 1979. 

[19] I. Csiszar and J. Korncr. InformMion Theory: Coding Theorems for Discrete Memoryless 
Systems. Akadcmiai Kiado: Budapest, 1981. 

[20] A. A. El Gamal. The capacity of a class of broadcast channels. IEEE Trans. Inform. Theory, 
25(2):166-169, March 1979. 

[21] E. C. van der Meulen. Random coding theorems for the general discrete memoryless broadcast 
channel. IEEE Trans. Inform. Theory, 21(2):180-190, March 1975. 

[22] S. I. Gel'fand. Capacity of one broadcast channel. Probl. Inform. Transm., pages 240-242, 
Jul.-Sept. 1977. 

[23] A. B. Carleial. Multiple-access channels with different generalized feedback signals. IEEE 
Trans. Inform. Theory, 28(6):841-850, November 1982. 

[24] T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley, New York, 1991. 

[25] I. Csiszar and J. Korner. Broadcast channels with confidential messages. IEEE Trans. Inform. 
Theory, 24(3):339-348, May 1978. 



41 



